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(54) Rhythm game apparatus and method 

(57) Sound generation control and instruction oper- 
ation evaluation is performed by sound group selection 
and a sound generation instruction, with a mimic guitar 
having selection buttons for selecting one of a plurality 
of sound groups bearing a series of sounds, and a pick- 
ing blade for instructing the generation of a sound. The 
rhythm-matching game can be enjoyed relatively easily 
in a manner closer to a realistic state of playing an 
instrument. 
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Description 

* * 

[0001] This application is based on patent applica- 
tion Nos. 10-326145 and 11 -21 4435 filed in Japan, the 
contents of which are hereby incorporated by refer- 
ences. 

BACKGROUND OF THE INVENTION 

1 . Field of the invention 

[0002] The present invention relates to a rhythm 
game apparatus for performing a musical rhythm- 
matching game and a rhythm game method, a compu- 
ter-readable storage medium wherein a rhythm game 
program thereof is stored, and an instrumental device 
used in a rhythm game apparatus. 

2. Description of the Related Art 

[0003] Conventionally, there are game systems 
wherein sounds are matched in rhythm with background 
music, or wherein a short playing of around one phrase 
or so is added and played. 

[0004] Also, an instrument which generates a cardi- 
ogram-like rhythm, which performs rhythm matching 
while watching a cardiogram-like rhythm, has been pro- 
posed (refer to Japanese Patent Publication (by PCT 
Application) No. 8-510849). 

[0005] However, with the above-described conven- 
tional rhythm-matching, the player cannot perform the 
rhythm-matching game in a manner closer to reality of 
an actual instrument by fully using the right hand and 
left hand. Also, it is foreseen that, in the event that a 
rhythm-matching game fully using the right hand and 
left hand is attempted in a manner closer to reality, the 
complexity will increase to an extreme degree, to where 
performing the rhythm-matching game becomes diffi- 
cult. 

SUMMARY OF THE INVENTION 

[0006] It is an object of the invention to provide a 
rhythm game apparatus, a rhythm game method, a 
computer-computer-readable storage medium for stor- 
ing a rhythm game program, an instrumental device for 
use in a rhythm game apparatus which have overcome 
the problems residing in the prior art. 
[0007] According to an aspect of the invention, a 
rhythm game apparatus comprises a sound data stor- 
age device for storing at least data concerning sounds, 
the sounds being sorted into a plurality of selective 
sound groups, a display device for displaying occur- 
rences of sounds in each of the plurality of selective 
sound groups in accordance with time passing, an 
instrumental unit to which a game player operates. The 
instrumental unit is provided with a sound group selec- 
tor operable by the game player to select a sound group, 



and an instructor operable by the game player to 
instruct generation of a sound. The operation of the 
game player is evaluated based on a time gap between 
the instruction timing of the instructor and the predeter- 

5 mined timing of a sound in a selected sound group. 
[0008] According to another aspect of the invention, 
a method for producing a rhythm game, comprises the 
steps of giving a game player a visual display of occur- 
rences of sounds in each of a plurality of selective 

10 sound groups in accordance with time passing; detect- 
ing a time gap between a predetermined generation tim- 
ing of a sound in a selected sound group and an 
instruction timing of the game player to judge whether 
the sound is allowed to be generated; generating the 

15 particular sound based on the judgment; and evaluating 
the operation of the game player based on the detected 
time gap. 

[0009] According to still another aspect of the 
invention, a computer-readable storage medium storing 

20 a program of executing the steps giving a game player a 
visual display of occurrences of sounds in each of a plu- 
rality of selective sound groups in accordance with time 
passing; detecting a time gap between a predetermined 
generation timing of a sound in a selected sound group 

25 and an instruction timing of the game player to judge 
whether the sound is allowed to be generated; generat- 
ing the particular sound based on the judgment; and 
evaluating the operation of the game player based on 
the detected time gap. 

30 [0010] These and other objects, features and 
advantages of the invention will become more apparent 
upon reading the following detailed description in con- 
junction with the accompanying drawings. 

35 BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] 

Fig. 1 is an external perspective view of a rhythm 
40 game apparatus according to an embodiment of the 
present invention; 

Fig. 2 is a configuration diagram of a mimic guitar 
shown in Fig. 1 ; 

Fig. 3 is an enlarged diagram of a neck portion 
45 shown in Fig. 2; 

Rg. 4 is a perspective view of a picking unit 
attached to the mimic guitar shown in Fig. 2; 
Rg. 5 is a plan view of the picking unit shown in Fig. 
4; 

so Rg. 6 is a frontal view of the picking unit shown in 
Rg- 4; 

Rg. 7 is a side view of the picking unit shown in Rg. 
4, in a used state; 

Rg. 8 is a diagram illustrating its movement at the 
55 time of activating the picking unit in Fig. 7; 

Rg. 9 is a block diagram illustrating a control config- 
uration of the rhythm game apparatus shown in Rg. 
1; 
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Fig. 10 is a groupchart illustrating an operation of 
the rhythm-matcfiing game apparatus shown in Fig. 
1; 

Fig. 11 is a groupchart illustrating a peripheral 
demo of the rhythm game apparatus shown in Fig. 
1; 

Fig. 12 is a difficulty selecting screen for the rhythm 

game apparatus shown in Fig. 1 ; 

Fig. 13 is a music piece selecting screen for the 

rhythm game apparatus shown in Fig. 1 ; 

Fig. 14 is a game screen for one player playing the 

rhythm game apparatus shown in Fig. 1 ; 

Fig. 1 5 is a game screen tor two players playing the 

rhythm game apparatus shown in Fig. 1 ; 

Fig. 16 is a stage results screen for the rhythm 

game apparatus shown in Fig. 1 ; 

Fig. 17 is a game over screen for the rhythm game 

apparatus shown in Fig. 1 ; 

Fig. 18 is a practice refrain stage screen for the 
rhythm game apparatus shown in Fig. 1 ; 
Fig. 19 is a model diagram illustrating the state of 
tower picking; 

Fig. 20 is a notes display diagram for guiding the 
timing for tower picking; 

Fig. 21 is a diagram illustrating another embodi- 
ment of the notes display portion; 
Fig. 22 is a frontal diagram illustrating another 
example of a mimic guitar used with the present 
invention; 

Fig. 23A is a cross-sectional view along line A-A in 
Fig. 22; 

Fig. 23B is a cross-sectional view along line B-B in 
Fig. 22; 

Fig. 24 is a disassembled perspective view of the 
mimic guitar shown in Fig. 22; 
Fig. 25 is a disassembled perspective view for 
describing the assembly process of the mimic gui- 
tar shown in Fig. 22; 

Fig. 26 is a disassembled perspective view for 
describing the assembly process of the mimic gui- 
tar shown in Fig. 22; 

Fig. 27 is a cross-sectional view for describing the 
assembly process of the mimic guitar shown in Fig. 
22; and 

Fig. 28 is a plan diagram for descrtoing the assem- 
bly process of the mimic guitar shown in Fig. 22. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[001 2] A rhythm game apparatus of the invention is 
mainly provided with a sound data storage device, a dis- 
play device, an instrumental unit, and an evaluator. The 
sound data storage device stores at least data concern- 
ing sounds, the sounds being sorted into a plurality of 
selective sound groups. The display device displays 
occurrences of sounds in each of the plurality of selec- 
tive sound groups in accordance with time passing. The 



instrumental unit is operated by a game player, and 
includes a sound group selector operable by the game 
player to select a sound group, and an instructor opera- 
ble by the game player to instruct generation of a sound. 

5 The evaluator evaluates the operation of the game 
player based on a time gap between the instruction tim- 
ing of the instructor and the predetermined timing of a 
sound in a selected sound group. There is further pro- 
vided a sound generator for generating an instructed 

10 sound. 

[0013] The rhythm game apparatus may be further 
provided with a judger for judging whether the instruc- 
tion timing of the instructor is within an allowable time 
range of the sound. 

is [0014] The sound generator may be made to gener- 
ate the sound when the instruction timing is within the 
allowable time range, or may be made to generate the 
sound at a predetermined interval when the instruction 
timing is within the allowable time range. Also, the 

20 sound generator may generate a background sound. 
The sound data may include scale data and/or chord 
data. 

[0015] The evaluator may evaluate the operation of 
the game player based on a total of differences with 

25 respect to a predetermined number of sounds. The 
evaluator may have for evaluation an addition parameter 
for a difference within a predetermined tolerance range 
and a subtraction parameter for a difference out of the 
predetermined tolerance range. 

30 [0016] The display device may be provided with a 
graphic storage device for storing note screen data for 
visually guiding the instruction operation, and a graphic 
generator for generating an updated note screen in 
accordance with time passing, and an updated failure 

35 screen indicative of whether or not the instruction timing 
is within the allowable range. 

[0017] One of the sound group selector and the 
instructor may be arranged for the right hand of the 
game player, and the other arranged for the left hand. It 

40 may be appreciated to make the instrumental unit in the 
form of a guitar. In this case, the sound group selector is 
configured into a plurality of neck buttons corresponding 
to the plurality of sound groups, respectively, and the 
instructor is configured into a picking unit. 

45 [0018] The picking unit may be provided with a pick- 
ing blade provided swingably, a restoring mechanism for 
restoring a blade portion of the picking blade into a ref- 
erence position with respect to the instrumental unit, 
and a swing detector for detecting a swing of the picking 

so blade to determine a sound generation timing. The 
restoring mechanism may include a pair of elastic mem- 
bers provided below the picking blade, one member of 
the pair being arranged on one swing side and the other 
member being arranged on the other swing side. Alter- 

55 natively, the picking blade may be formed with a protru- 
sion extending inside, and the restoring mechanism 
includes an elastic member for holding the protrusion of 
the picking blade in a swingable manner. There may be 
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w further provided a posture detector for detecting 
whether the instrumental unit is placed in a particular 
posture in a predetermined time so that the evatuator 
gives an additional score to the evaluation when the 
instrumental unit is placed in the particular posture in 
the predetermined time. 

[0019] The instrumental unit or device for use with 
the rhythm game apparatus may be provided with a 
sound group selector which is to be operated by one of 
the both hands of a game player to select a sound 
group; and an instructor which is to be operated by the 
other hand of the game player to instruct the sound gen- 
erator to generate a sound. 

[0020] A rhythm game producing method of the 
invention comprises the steps of: giving a game player a 
visual display of occurrences of sounds in each of a plu- 
rality of selective sound groups in accordance with time 
passing; detecting a time gap between a predetermined 
generation timing of a sound in a selected sound group 
and an instruction timing of the game player to judge 
whether the sound is allowed to be generated; generat- 
ing the particular sound based on the judgment; and 
evaluating the operation of the game player based on 
the detected time gap. The game player may be given a 
background music in connection with the displayed 
sound occurrences. 

[0021] A computer-readable storage medium of the 
invention stores a program of executing the steps of: 
giving a game player a visual display of occurrences of 
sounds in each of a plurality of selective sound groups 
in accordance with time passing; detecting a time gap 
between a predetermined generation timing of a sound 
in a selected sound group and an instruction timing of 
the game player to judge whether the sound is allowed 
to be generated; generating the particular sound based 
on the judgment; and evaluating the operation of the 
game player based on the detected time gap. 
[0022] A computer-readable storage medium of the 
invention stores a program of executing the steps of: 
giving a game player a visual display of occurrences of 
sounds in each of a plurality of selective sound groups 
in accordance with time passing; detecting a time gap 
between a predetermined generation timing of a sound 
in a selected sound group and an instruction timing of 
the game player to judge whether the sound is allowed 
to be generated; generating the particular sound based 
on the judgment; and evaluating the operation of the 
game player based on the detected time gap. 
[0023] Further, the invention provides a product of 
computer program executing the steps of: giving a 
game player a visual display of occurrences of sounds 
in each of a plurality of selective sound groups in 
accordance with time passing; detecting a time gap 
between a predetermined generation timing of a sound 
in a selected sound group and an instruction timing of 
the game player to judge whether the sound is allowed 
to be generated; generating the particular sound based 
on the judgment; and evaluating the operation of the 



game player based on the detected time gap. 
[0024] Next, a specific rhythm game apparatus 
embodying the present invention will be described with 
reference to the drawings. Fig. 1 is an external perspec- 

s tive view of a rhythm game apparatus according to an 
embodiment of the present invention. In Fig. 1, the 
rhythm game apparatus 1 has a certain degree of angle 
at the front upper portion of the housing, and a televi- 
sion monitor 2 for outputting various types of images 

10 relating to the rhythm game is provided to the center 
position of the inclined plane. Also, start buttons 3 are 
provided to the left and right at the near side below the 
monitor, with two coin deposit openings 4 being pro- 
vided to the lower side thereof on the right and left Fur- 

15 ther, mimic guitars 5 which are mimic instruments 
serving as the instrumental unit for the players to per- 
form rhythm input for sound generation operation are 
provided to both the left and right sides of the monitor 2, 
respectively. Further, lamps 6 for staging effects for the 

20 played music piece are provided on the housing above 
the monitor 2. 

[0025] In this way, two mimic guitars 5 are provided 
together, so that two players can each conduct input 
operation of each mimic guitar 5 and play the rhythm- 

25 matching game, or that one player can conduct opera- 
tion of one mimic guitar 5 and play the rhythm-matching 
game. Whether one player or two players will play is 
determined by depositing a certain monetary value in 
both coin deposit openings 4 to the left and right, or by 

30 depositing a certain monetary value in one. 

[0026] Fig. 2 is a configuration diagram of the mimic 
guitar 5 shown in Fig. 1, and Fig. 3 is an enlarged dia- 
gram of the neck portion shown in Fig. 2. In Figs. 2 and 
3, the mimic guitar 5 is provided with three neck buttons 

35 R, Q, and B, serving as a sound group selector for 
selecting one from the plurality of types or sound groups 
each bearing rhythm sounds for the played music piece, 
each sound following the time-wise group of the played 
music piece; a picking unit 7, serving as an instructor for 

40 instructing generation of a sound in the selected sound 
group by the selecting operation of at least one neck 
button of these neck buttons R, G, and B, and a rotary 
switch 8 provided below the picking unit 7 for switching 
added modes such as an echo mode in which the same 

45 type of sounds are generally generated in a sequential 
manner and a chorus mode in which different types of 
sounds are generally generated at the same time. 
These neck buttons R, G, and B are left-hand input 
means for inputting guitar chords and the like, and the 

so picking unit 6 is a right-hand input means for inputting 
guitar picking; the left-hand and right-hand arrange- 
ments may be reversed. 

[0027] Figs. 4 through 8 are configuration diagrams 
of the picking unit 7 attached to the mimic guitar 5. In 
55 Figs. 4 through 8. the picking unit 7 is comprised of a 
picking blade 72 wherein the tip portion of a rib-shaped 
piece 721 is swingably axially supported in the longitu- 
dinal direction centered around a shaft 71 within a cer- 
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tam angle range, an elastic member 73 which is 
positioned at the ba§e portion of the picking blade 72 
and serves as a restoring means for restoring the tip 
portion of the rib-shaped piece 721 automatically so as 
to face outwards, a turning detector 74 for detecting the 
turning of this picking blade 72, and an attachment plate 
76 with attachment holes 75 for attaching to the main 
body of the mimic guitar 5, wherein sound generation 
signals are output for the first turning detecting timing of 
the picking plate by the turning detector 74 as the sound 
generation instructing timing, as described later. 
[0028] This elastic member 73 may be a compres- 
sion spring, or may be an elastic material such as rub- 
ber. The elastic member 73 is provided at four corners, 
i.e.. two places for each swinging direction, so as to uni- 
formly press the base portion of the picking blade 72 
and maintain the balance thereof. Picking the rib- 
shaped piece 721 downwards as indicated by the imag- 
inary une A shown in Fig. 8, causes the two elastic 
members 73 to the lower side to be compressed, and 
the two elastic members 73 to the upper side are 
stretched, so that the pressing force of the elastic mem- 
bers 73 on the picking blade 72 acts to cause the fib- 
shaped piece 721 to rock upwards as indicated by the 
imaginary line B shown in Fig. 8 
[0029] Also, as shown in Fig. 5, the swing detector 
74 has oppositely-positioned element attaching mem- 
bers 741 attached to the attachment plate 76 with a 
holding member 77 introduced therebetween, transmit- 
ting photo-sensors 742 positioned to the element 
attaching members 741 so that the photo-emitting side 
and photo-receptor side are arranged in an oppositely 
facing manner, and a light-shielding piece 743 movable 
between the photo-emitting side and photo-receptor 
side, such that in the event that the picking blade 72 is 
stationary the light-shielding piece 743 shields the 
photo-sensor 742 so the photo-sensor 742 is in an off 
state, and in the event that the rfo-shaped piece 721 is 
picked the light-shielding piece 743 moves in accord- 
ance with the rocking of the picking plate 72 and the 
photo-sensor 742 turns on, following which a sound 
generation instructing signal is output at a certain tim- 
ing. This sound generation instruction signal is output 
after the lapse of a predetermined time from the first off 
time following on the photo-sensor 742 turning on. This 
is in order to approximate the state of an actual guitar 
string being picked to generate sound, in order to create 
a more realistic atmosphere. 

[0030] Fig. 9 is a block diagram illustrating the con- 
trol configuration of the rhythm game apparatus 1 
shown in Fig 1 . in Fig. 9, the control means 1 1 has a 
PCM data storage unit 12, a main RAM 13 capable of 
reading and writing various types of data, a sound proc- 
essor 1 4 connected to the PCM data storage unit 12 for 
extracting sound generation data from the PCM data 
storage unit 12 and performing sound generation con- 
trol, a mixing device 17 connected to the sound proces- 
sor 14 for mixing the sound generation data from the 



sound processor 14 and background music data from a 
CD-ROM 15 for output to a speaker 16 serving as 
sound generation device, graphic RAM 18 serving as 
graphic storage means for storing image data for the 

5 monitor 2, a graphic controller 1 9 connected to the mon- 
itor 2 for extracting the image data within the graphic 
controller 18 and performing display control to the mon- 
itor 2, an interface 20 for receiving input signals from the 
mimic guitars 5 and CD-ROM 1 5, a lamp driving unit 21 

io connected to the lamps 6 for driving the lighting of the 
lamps 6, and a CPU (Central Processing Unit) 22 for 
controlling each portion. A graphic controller is com- 
prised of the main RAM 13, graphic RAM 18, graphic 
controller 19. and CPU 22. 

is [0031] The PCM data storage unit 12 stores each 
sound of sound generation data (type of sound data; 
type selected with buttons R, G, B) of a played music 
piece. Such sound generation data for multiple music 
pieces for each play level is stored in the PCM data stor- 

20 age unit 1 2. This sound generation data consists of sec- 
tor No. provided to the CD-ROM 15. sound No. (Nos. 
provided to each of a series of sounds arrayed in a time 
system for each played music piece), sound generation 
length, and type of neck button (R. G, B). Also, as 

2F shown in the notes display 31 shown in Fig. 14, the 
graphic RAM 18 divides the rhythm sounds (notes bar 
34 corresponding to the rhythm sounds) of a played 
music piece comprised containing at least rhythm 
sounds into certain intervals (which may be different for 

30 each sound, or may be the same) in the time direction 
C, and also stores each of a series of rhythm sounds 
constructed by appropriating to the three types (R, G, B) 
on the same time axis, for each sound, as image data 
for the above-described monitor 2. This image data is 

c5 subjected to data loacfing from the CD-ROM 15 in the 
later-described step ST2. 

[0032] Also, the CD-ROM 1 5 serving as the storage 
medium is comprised of a so-called ROM cassette 
wherein a plastic case houses ROM and the like storing 

40 the above image data, and also the background music 
data for played music pieces, and further storing the 
selective sound group data (type of neck button) and the 
specified generation timing data (sound No.) of each 
sound, and storing score data according the degree of 

45 matching of these, and storing program data such as 
programs for the rhythm game, operating system, and 
so forth. The recording medium may be comprised of an 
optical disk or a flexible disk or the like, instead of the 
CD-ROM 15. 

so [0033] Further, the graphic RAM 18 stores screens 
(Figs. 12 through 18) according to the later-described 
game conditions and data related thereof, such as 
notes screen data for instruction operation for visually 
guiding the instruction operation with the mimic guitar 5. 

55 [0034] The CPU 22 causes an not-shown reading 
device to read the program data and data related 
thereto (score data, selective sound group data, true 
sound generation timing data, etc.) within the CD-ROM 
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15 from the CD-ROM 15, to be written to the main RAM 
13. 

[0035] Also, the CPU 22 controls the graphic con- 
troller 19 according to the processing state of the stage 
selection, based on the program, and extracts neces- 
sary image data from the graphic RAM 18 and displays 
this on the monitor 2, while performing game stage 
selection processing by operation with the neck buttons 
R, G, B on the mimic guitar 5 and the start button 3. This 
stage selection processing includes selection of one 
player to play or two players to play, selection of diffi- 
culty, and selection of played music piece. 
[0036] For example, in the event of selecting two 
players to play, this is selected by depositing a certain 
monetary amount from both left and right coin deposit 
openings 4 of the rhythm game apparatus 1, and the 
CPU 22 controls the graphic controller 19 to display a 
display screen on the monitor 2 such as shown in Fig. 
1 2 ("credits 02" indicating two players to play), using the 
data within the graphic RAM 18. 
[0037] Selection of difficulty involves a difficulty 
selection screen (guidance "select with neck button", 
"confirm with start button") on the monitor 2 such as 
shown in Fig. 12, the player sequentially selecting from 
the three stages of play level of advanced (expert), 
medium (normal), and beginner (practice) with the neck 
button R or the neck button Q. and the CPU 22 control- 
ling the graphic controller 19 according to the level of 
difficulty selected thereby to control display on the mon- 
itor 2 such that the title and number of shining stars 
change. For example, in Fig. 12, a screen of a bear 
holding a mimic guitar 5 is displayed on the monitor 2 
with the title "PRACTICE" of the beginner stage and two 
of the six stars shining, from which pressing the neck 
button R once changes the screen displayed on the 
monitor 2 to that wherein a bear holding a different 
mimic guitar with the title "NORMAL" of the medium 
stage comes up and four of the six stars are shining, 
and further, pressing the neck button R once more 
changes the screen displayed on the monitor 2 to that 
wherein a bear holding another different mimic guitar 
with the title "EXPERT" of the advanced stage comes 
up and six of the stars are shining, and moreover, press- 
ing the neck button R once more returns to the beginner 
"PRACTICE" screen. Incidentally, the arrangement is 
such that each time the neck button B is pressed, the 
play level changes in reverse from advanced to medium 
to beginner. Pressing the start button 3 according to the 
operation guidance "confirm with start button" deter- 
mines the play level displayed on the monitor 2. 
[0038] Further, for selecting the played music piece, 
a plurality of (five in the present embodiment) mimic gui- 
tars with shapes according to the played music piece 
are displayed on the monitor 2 as shown in Fig. 13, and 
the title of a played music piece corresponding to the 
mimic guitar at the center (the center guitar is shining, 
and the other guitars are not shining, as represented by 
the hatching) is displayed on the monitor 2. From this 



display state, each time the neck button R is pressed, 
the five mimic guitars sequentially move to the right, 
with the mimic guitar situated at the far right moving to 
the far left, and the title of a played music piece corre- 

5 spending to the mimic guitar at the center is displayed. 
Also, the arrangement is such that each time the neck 
button B is pressed, the five mimic guitars sequentially 
move in the opposite direction (to the left) as that with 
the neck button R. The title of the played music piece 

w "Chicago Blue" is displayed at the title portion of the 
screen of the monitor 2 shown in Fig 13, indicating the 
state that the same has been selected. In the event that 
this selected piece is suitable, the start button 3 is 
pressed according to the operation guidance "confirm 

is with start button" on the monitor 2, thereby confirming 
the played music piece. 

[0039] Also, the CPU 22 has a judging means for 
judging whether or not the sound data selected with the 
neck buttons (sound group selector) R, G, B, is 

20 instructed as operating timing within the certain interval 
by operating of the picking unit 7 according to the sound 
generation control procedures of the program; a sound 
generation controller for extracting one piece of sound 
generation data from the played music piece from the 

25 PCM data storage unit 1 2 with the sound processor 14 
according to the type of neck button R. Q, B from the 
mimic guitar 5 and the generation timing (sound No.) 
thereof, in a state affirmed by the judging means at 
least, this one piece of sound generation data being out- 

30 put to the mixing unit 17 where the one piece of sound 
generation data and background music data from the 
CD-ROM 15 are mixed and sound is generated from the 
speaker 16; and a display device for updating notes 
screen data according to the time-system group of the 

35 played piece according to the notes display control pro- 
cedures of the program, and also performing display 
control on the monitor 2 of whether or not there has 
been a miss in the input operation with the mimic guitar 
5; and rhythm input instrumental unit for following the 

40 rhythm input operating evaluating procedures of the 
program to check the selection operation of the mimic 
guitar 5, and compare the generation instruction timing 
with the true generation timing of the sound, and per- 
form evaluation of instruction operation for the score 

45 data according to the degree of matching, whereby 
points are added to the score. The sound generation 
controller has difference amount detector and sound 
generation control means. 

[0040] Detailed description will now be made 
so regarding the sound generation control processing and 
the display control processing. The CPU 22 via the 
sound processor 14 obtains the CD sector No. where 
the sound generation data of the PCM data storage unit 
12 corresponding to the next sound generation of the 
55 selected piece is to be positioned, and controls the 
graphic controller 19 such that image data is read from 
the graphic RAM 18 which is the graphic storage means 
to the next notes display position 31 so as to update it, 
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-• thereby displaying on the monitor 2 as shown in Fig. 1 4 
or Fig. 1 5. That is to £ay, the sector No. for which the CD 
head is searching is obtained at each interruption in the 
program, and the note display position 31 shown in Fig. 
14 or Fig. 15 is moved one step upwards, so that the 
player selects and operates the neck button corre- 
sponding to the R, G, B notes bar 43 which has reached 
the reference line 32 at the topmost position, and also 
picks the picking unit 7. 

[0041] In this way, the operator watches the notes 
display (neck button operating procedures) 31 at the left 
side of the monitor 2 in Fig. 14, and operates the neck 
button R, G, B, with the left hand along with the back- 
ground music, and also operates the picking lever 72 
with the right hand to input operating signals to the CPU 
22. At this time, the CPU 22 obtains the degree of 
matching with the time-system data in the table, at the 
point that there is signal input within the certain timing 
period. 

[0042] This degree of matching is the extent to 
which the type of neck button (R. G, B) operated and the 
timing of picking match. For example, in the event that 
the sound generation has the sector No. obtained at the 
time of picking input and the sector No. of the corre- 
sponding time-system data within the certain interval, 
and also that the next button written to the neck button 
type on the same table has been pressed, the sound 
data corresponding to the sound No. within the same 
table is emitted for the sound generation length of that 
sound data. Also, in the event that the type of neck but- 
ton is correct, but the picking is made extending before 
or after the certain interval (a case wherein the picking 
is not contained within the certain interval), the opera- 
tion is admitted, and comparison is made in the corre- 
sponding table before and after, and the close is emitted 
as sound. The display to the monitor 2 at this time is a 
"fail" display (gray). Incidentally, a "success" display is lit 
as a color corresponding to the operated neck button R, 
G, B with the notes bar 34 of the notes display 31 . Also, 
in the event that the picking input time is within the cer- 
tain interval but the neck button type is wrong, a sound 
No. is obtained from the table with the data of the clos- 
est same type of button. The display to the monitor 2 at 
this time also is a "fail" display (gray). In this way, the 
CPU 22 controls the sound processor 14 to obtain 
sound data from the PCM data storage device 1 2 for the 
sound selected by the player with the neck button at the 
timing of operating the picking lever, which is generated 
via the speaker 16. 

[0043] Next, the instruction operation evaluating 
processing will be described in detail. The CPU 22 is 
arranged so as to extract score points from the score 
point table according to various conditions such as 
amount of picking difference from the reference timing 
range, different neck button types, whether continuous 
input operations are correct or not, whether there is no 
input of operating instructing signals which should be 
made within the certain timing period, and so forth, fol- 



lowing the instruction operation evaluation procedures 
of the program and the game data, thereby calculating 
the score. Also, the CPU 22 is arranged to calculate the 
amount of time (gauge amount) necessary till sound 

5 generation. Based on the gauge amount calculation 
results and the score calculation results, the calculated 
score points are added to the accumulated score points 
and updated and stored to the main RAM 13, and at the 
same time the calculated gauge amount is subtracted 

w from the remaining life amount and the remaining life 
amount is updated, so that the remaining life amount is 
displayed on the monitor 2 as a horizontal bar graph 33. 
In the even that there is no updated remaining life 
amount, the CPU 22 displays a "Game Over display 

is such as shown in Fig. 17 on the monitor 2, and the 
rhythm game is ended. 

[0044] Further, tower picking of the mimic guitar 5 
will be described. An over-turn detecting unit (not 
shown) is set within the mimic guitar 5, so as to detect 

20 the angle of the mimic guitar 5 while playing. By adding 
an action of holding the mimic guitar 5 vertically at a cer- 
tain point in the played music piece as shown in Fig. 19, 
the over-turn detecting unit detects this and outputs a 
detection signals, whereby the CPU 22 obtains high 

25 score points from the main RAM 13, adds to the score 
and stores in the main RAM 13. following the tower pick- 
ing evaluation procedures of the program, and at the 
same time the arrangement is such that the lamp driving 
unit 21 is controlled to light the lamps 6. thereby staging 

30 a fanatical live performance. This action is in order to 
encourage over-acting while playing the game, so there 
are no minus actions taken such as reducing the score 
in the event that this action is not performed. Also, 
regarding the detection timing for this action, since there 

35 are differences in the action and many different opera- 
tion images, a guitar mark appears to the right side of 
the notes display portion 31 from one frame ahead as 
shown in Fig. 20, this guitar mark ascends along with 
the group of the played music piece, so that the timing 

40 matches if the mimic guitar 5 is raised when this 
reaches the position of the reference line 32. 
[0045] The operation of the above configuration will 
be described below. Fig. 10 is a groupchart illustrating 
the operation of the rhythm-matching game apparatus 

45 shown in Fig. 1. As shown in Fig. 10, first, in step ST1, 
stage selection is made from the various stages. That 
is, whether one is to play or two is to play is selected by 
depositing a certain monetary amount in both coin 
deposit openings 4 on the left and right side of the 

so rhythm game apparatus 1, or by depositing in only one. 
An initial display screen such as shown in Fig. 12 is dis- 
played on the monitor 2. and a display such as "credits 
02" is made in the event that two are to play. Also, coins 
for two have been deposited by only one person has 

55 taken a mimic guitar 5. so the display screen displays a 
comment such as "OK to participate partway through" 
shown in Fig. 12 is displayed in order to urge another to 
play. 
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[0046] Also, this display screen is a difficulty display 
screen, where selection is sequentially made from the 
three stages of play level of advanced (expert), medium 
(normal), and beginner (practice) with the neck button R 
or G, following the difficulty selection guidance "select 
with neck button", and for example, the beginner title 
"PRACTICE" with two of the six stars shining as shown 
in Fig. 12 is selected. Next, the start button 3 is pressed 
following the operation guidance of "confirm with start 
button** on the monitor 2, confirming the beginner level 
for the play level. 

[0047] Further, selection of the played music piece 
is performed by five mimic guitars having shapes corre- 
sponding to the played music piece being displayed on 
the monitor 2 as shown in Fig. 1 3, and the played music 
piece being selected by pressing the neck button R. In 
Fig. 13, the title of the played music piece "Chicago 
Blue" corresponding to the mimic guitar at the center is 
displayed. In the event that this is suitable, the start but- 
ton 3 is pressed following the operating guidance "con- 
firm with start button" on the display screen, thereby 
confirming the played music piece. 
[0048] Next, data loading is performed in step ST2. 
Programs instructing the procedures of the rhythm- 
matching game and related data other than background 
music data is read into the main RAM 13 from the 
recording medium CD-ROM 15 via the flash ROM on 
the main substrate. In other words, the background 
music is directly generated from the speaker 16 as 
background music sounds from the CD-ROM 15 shown 
in Fig. 9 via the mixing unit 1 7. Thus, when preparations 
for playing are completed, the game screen is displayed 
on the monitor 2 in step ST3. Fig. 14 illustrates the 
game screen for a single player, and Fig. 15 illustrates 
the game screen for two players. Here, the screen for a 
single player will be described, in order to facilitate ease 
of description. A notes display 31 is carried out to the 
left side of the monitor 2, showing the neck button oper- 
ating procedures for the selected music piece, displayed 
with different colors tor each of the neck buttons R, Q, 
and B, and the playing of the selected piece thus starts. 
[0049] Further, in step ST4 the CPU 22 obtains the 
CD sector No. that the CD is currently playing, and in 
step ST5 updates the position of the notes display 31. 
The player watches the notes display 31 (neck button 
operating procedures) at the left side of the monitor 2, 
and operates at least one of the neck buttons R, Q, and 
B with the left hand, and also operates the picking lever 
72 with the right hand, along with the background 
music, thereby outputting the instruction signal to the 
CPU 22. At this time, the CPU 22 judges whether or not 
there has been signal input within the certain timing 
period in step ST6. 

[0050] At the point that there has been operating 
input by picking performed by the player in step ST6 t in 
step ST7 the degree of matching of the type of operated 
neck buttons R, G, and B and the picking timing with the 
time-system data (the type of buttons and the true gen- 



eration timing of sounds) in the table is obtained, and in 
step ST8. the CPU 22 controls the sound processor 14 
to obtain sound data for the played music piece from the 
, PCM data storing unit 12, based on the type of button 

5 selected with at least one of the neck buttons R, G. and 
B at the timing that the picking lever 72 was operated, 
which is generated via the speaker 16. 
[0051] Further, in step ST9, calculation of the 
remaining life amount (gauge amount) wherein the 

10 game can be played, and calculation of the score is per- 
formed. Score points are extracted form the score point 
table according to conditions such as amount of picking 
difference from the reference timing range, wrong neck 
button types, correct continuous input operations, cases 

75 wherein there is no input of operating instructing signals 
which should be made within the certain timing period in 
step ST6, such as described above, and the score is 
calculated. Also, the amount of time necessary for the 
operating input is calculated. 

so [0052] Further, based on the gauge amount calcu- 
lation and score calculation results in step ST9, the 
gauge, score, and staged effects are updated in step 
ST10. The score points calculated in step ST9 are 
added to the accumulated score points and updated 

25 and stored in the main RAM 13. Also, the gauge amount 
calculated in step ST9 is subtracted from the remaining 
life amount and the remaining life amount is updated 
and recorded, and the remaining life amount is dis- 
played on the monitor 2 as a horizontal bar graph, as 

30 shown by 33 in Fig. 1 4. 

[0053] Further, in step ST11, the CPU 22 judges 
whether or not there is updated remaining life amount, 
and in the event that there is no remaining life amount a 
"Game Over" display such as shown in Fig. 17 is dis- 

35 played on the screen on the monitor 2 in step ST12. 
[0054] Further, in step ST13, judgment is made 
whether or not the selected piece has ended, by detect- 
ing whether or not there is an ending symbol which has 
been added to the end of the PCM data of the selected 

40 piece which the CPU 22 has obtained via the sound 
processor 14. In step ST13, in the event that the CPU 
22 judges that the playing of the selected music piece 
has not ended, the group returns to step ST3, performs 
the series of processing for the next sound (steps ST3 

45 through ST1 3), which is repeated until the playing of the 
selected music piece ends. 

[0055] in the event that the CPU 22 detects the end- 
ing symbol which has been added to the end of the 
PCM data of the selected piece and thus judges in step 

so ST13 that playing of the selected piece has ended, in 
step ST14 the CPU 22 controls the graphic controller to 
display a stage results display such as shown in Fig. 16 
on the monitor 2 as an evaluation of the playing, based 
on the score calculation results. 

55 [0056] Subsequently, in step ST15, the CPU 22 
judges whether or not the stipulated number of stages 
(e.g., up to three selected pieces can be selected) has 
been achieved, and end in the event that this has been 
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achieved, and returns to step ST1 to repeat the above 
series of actions in the event that this has not been 
achieved. 

[0057] Next, description will be made regarding the 
peripheral demo. Fig. 11 is a groupchart illustrating the s 
peripheral demo for the rhythm game device shown in 
Fig. 1. First, in step ST21, a warning screen displaying 
a warning text such as age restriction or the like is dis- 
played on the monitor screen, in step ST22 the Konami 
logo mark is displayed, in step ST23, an opening video io 
is displayed, in step ST24, the title for the rhythm- 
matching game is displayed, and further, in step ST25, 
hew to play this rhythm-matching game (operation 
method) is explained. 

[0058] Further, in step ST26, a noted piece demo is is 
performed. That is, the number of times that each piece 
has been selected in the rhythm game is recorded fol- 
lowing data initialization once every certain period such 
as a week, and that data is used to read the date and 
time, and a piece matching that period such as the sea- 20 
son, day of the week, or the like is introduced, and also 
the piece with the greatest number of selections when 
demo looping is output as audio as the "No. 1 popular 
piece". 

[0059] In step ST27. the name of the high-score 25 
player and the high score thereof for the week is dis- 
played in order of high score, this performing a ranking 
demo. Subsequently, the group returns to the warning 
screen in step ST21. Incidentally, the rhythm game 
apparatus 1 is arranged such that the player name can 30 
be input from input means in the event that a certain 
high-score value is passed. 

[0060] In the event that a coin is deposited during 
the above routine, the title display in step ST24 is per- 
formed. 35 
[0061] The operation of the refrain mode for prac- 
tice will be described. When the setting for the refrain 
mode is made, first, a teacher for performing a model 
performance appears on the monitor 2 and plays a cer- 
tain practice piece, which the player listens to and 40 
learns the sense of timing. Next, a monitor screen such 
as shown in Fig. 18 is displayed, and the neck button 
operating procedures for that practice piece are dis- 
played on the position of the notes display 31, along 
with which at least one type from the neck buttons R, G, 45 
B and picking is performed, whereby sound is gener- 
ated according to the type of neck button and picking 
timing. In the event that the type of neck button and pick- 
ing timing of the player match that of the teacher, the 
notes bar 34 of the notes display 31 is displayed with the so 
colors R, G, and B, corresponding with the types of neck 
buttons, and in the event that this does not match, the 
RGB colors disappear and become gray, thereby allow- 
ing judgment whether or not this has matched. 
[0062] The sound generation control and instruction 55 
operation evaluation is performed according to the 
sound group selection (type of buttons R. G, B) with the 
left hand of the mimic guitar 5 and the instruction timing 



with the right hand, so a rhythm-matching game can be 
enjoyed relatively easily in a manner closer to a realistic 
state of playing an instrument, fully using the right hand 
and left hand. 

[0063] When conducting this rhythm-matching 
game, the changing sound group selection and the true 
sound generation timings are displayed on the monitor 
2, so the rhythm-matching game can be performed in an 
easier and more sure manner, such that rhythm-match- 
ing becomes easier for even relatively difficult pieces, so 
the game becomes even more enjoyable. 
[0064] The present embodiment is a case wherein 
the rhythm game apparatus 1 is applied to playing with 
a mimic guitar 5, and the player can perform the rhythm- 
matching game in a manner closer to a realistic state 
using the right hand and left hand. 
[0065] Further, according to the picking unit 7 of the 
present embodiment, a simpler configuration can be 
used to ootain a realistic feel close to that of picking a 
mimic guitar 5, and more precise generation instruction 
can be attempted. 

[0066] The sound generation is made based on the 
degree of matching of the sound group selection and 
instruction timing, so sound generation according to the 
played music piece can be made in a more natural man- 
ner. 

[0067] The way of holding the rhythm input instru- 
mental unit 7 can be changed with the sensation of a 
live performance, such that in the case of a mimic guitar 
5, the action of raising along with the music allows the 
rhythm-matching game to be enjoyed in a more fanatical 
manner. 

[0068] Incidentally, though the configuration with 
the present embocfiment has been described as with 
the notes display 31 in Fig. 14, as shown in Fig. 21, the 
display for instructing the sound generation timing with 
the display device has the identification marks 35 being 
sequentially display by scrolling from one side of the dis- 
play screen of the display means (monitor 2) to the other 
side, and timing marks 36 are moved and displayed so 
as to head for the corresponding identification marks 35 
from the position generally corresponding to the identifi- 
cation marks 35, in a direction at right angles with the 
above scrolling direction, so that at the point that the 
display position between the identification mark 35 dis- 
played at the other-most side and the timing mark 36 
corresponding to this identification mark 35 reach a cer- 
tain relation, preferably the point of matching, this is 
instructed as the sound generation timing. In this exam- 
ple shown in the Figure, the one side of the display 
screen is the right side of Fig. 21 , and the other side is 
the leftside in Fig. 21. 

[0069] Incidentally, the present invention is not 
restricted to the above embodiment; rather, the follow- 
ing variations can also be employed. 

(1) The sound generation needs only to contain 
rhythm sound, out of rhythm sound, scales, and 
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chord sounds (chords). 

(2) Thg rhythm Input instrumental unit 7 is config- 
ured such that the picking blade 72 swings, but the 
present invention is not restricted to this, and an 
arrangement may be made wherein this slides; in s 
effect, the picking blade 72 should be configured 
swingably. 

(3) The instruction timing of the instructor as to the 
sound data instructed as operating timing and the 
operating timing display instruction are compared, 10 
and the instruction operation is evaluated based on 
the amount of difference thereof, wherein the evalu- 
ation means may be evaluated form the total 
amount of difference obtained by accumulating the 
difference amount to each piece of sound data, or 75 
the evaluator may set a tolerance range before and 
after the operating timing for each sound data, and 
calculate score by accumulating subtraction param- 
eters set according to the smallness of the amount 

of being off within the inner side of the boundary of 20 
the tolerance range as a reference thereof, and 
addition parameters set according to the greatness 
of the amount of being off at the outer side thereof. 

(4) In the node display 31, the notes bars 34 of 
rhythm sounds sequentially move upwards along 25 
with elapsing of time, toward the reference line 32, 
with the point of matching the reference line 32 
being the operating timing, and here, the notes bars 

34 move, but the invention is not restricted to this, 
so the reference line 32 may move, or the reference 30 
line 32 and the notes bars 34 may move, with the 
overlapping point being the operating instructing 
timing. 

(5) The arrangement is such that one or multiple 
pieces can be selected from five pieces for three 35 
stages of play levels, advanced (expert), medium 
(normal), and beginner (practice), but an arrange- 
ment may be made wherein multiple pieces (e.g., 
two) other than the five are hidden, and at the point 
that the selection of pieces remaining is close to 40 
being depleted, the hidden two pieces then appear 

on the monitor 2, so as to be selectable. This 
reduces the unfairness for individuals selecting 
pieces at the point that the selection of pieces 
remaining is close to being depleted, and the 45 
rhythm-matching game can be enjoyed more. 

(6) A description has been made using mimic gui- 
tars 5 as the instrumental unit, but the invention is 
not restricted to this, and can be applied to instru- 
ments such as cellos, violins, ukuleles, shamisens, so 
kotos, etc. In the case of cellos or violins, a bow-like 
member would be used instead of the picking. 

(7) The three neck buttons are provided, but this 
number may be one, or any other number, and in 

the case of a plurality thereof, this would mimic a ss 
guitar. Also, the operation input to the neck button 
may be performed to one neck button, or simultane- 
ously with multiple neck buttons. 



(8) The one rhythm input instrumental unit 7 having 
a picking blade 72 is provided, but the invention is 
not restricted to this, and a plurality thereof may be 
provided. In this case, the more picking blades 72 
there are provided, the more realistic the playing 
becomes, and in the event that six or twelve are 
provided for example corresponding to the strings 
on a guitar, guitar accompaniment and arpeggio, or 
even playing of melody and chords separately can 
be performed, thus coming closer to guitar playing 
and allowing the game to be enjoyed more. 

(9) The sound generation controller is configured so 
as to output the sound data instructed as the oper- 
ating timing to the sound generation device and be 
generated, but the invention is not restricted to this, 
and the sound generation device may be controlled 
so as to conduct sound generation only of back- 
ground music, without outputting instructed sound 
data to the sound generation device, with evalua- 
tion of the operation being displayed and output in 
the same manner as with the above embodiment. 

(10) The present embodiment uses the configura- 
tion shown in Figs. 2 through 8 for the mimic guitar, 
but the present invention is not restricted to this. For 
example, such as shown in Figs. 22 and 23 can be 
used. 

[0070] This mimic guitar 80 has three neck buttons 
R, G. and B, serving as the rhythm sound selecting 
means (sound group selector) for selecting the type of 
rhythm sound for each sound following the time-wise 
group of the played music piece from the plurality of 
rhythm sounds of the played music piece, a picking unit 
83 serving as sound generation instructing member for 
instruction the generation of a sound in the sound group 
selected by the selecting operation of at least one neck 
button of these neck buttons R, G, and B, a push switch 
81 provided lower than the picking unit 83 for switching 
added modes such as the echo mode (wherein gener- 
ally the same type of sounds are generated in a sequen- 
tial manner) and chorus mode (wherein different types 
of sounds are generated generally at the same time), 
and a push switch 82 for starting playing. These neck 
buttons R, Q, and B are left-hand input means for input- 
ting guitar chords and the like, and the picking unit 83 is 
a right-hand input means for inputting guitar picking; the 
left-hand and right-hand arrangements may be 
reversed. 

[0071] Figs. 23A and 23B are configuration dia- 
grams of the picking unit 83 attached to the mimic guitar 
80 shown in Fig. 22. 

[0072] This picking unit 83 has a picking blade 84, 
an elastic nipping member 100 swingably supporting 
this picking blade 84, and swing detector 86 for detect- 
ing the swinging of the picking blade 84 provided to both 
sides of the base of the picking blade 84. Also, as 
shown in Figs. 22 through 24, this mimic guitar 80 is 
comprised of a main body 80A, a neck unit 80B to which 
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the neck buttons R, G, and B are provided, and a rear 
unit 80C, with an opening 80a provided in the main body 
SOA and an opening 80b provided in the neck unit 80B 
generally matching. 

[0073] The picking blade 84 is formed so as to have s 
a mountain-shaped cross-sectional form with the base 
opened, having an apex 841, two protrusions 842 
formed protruding at a certain thickness downwards 
from two locations on the inner side of the apex 841 , two 
shaft portions 843 having round cross- Sectional forms 10 
protruding outwards from both sides, and two pressing 
portions 844 wherein the wall thickness of the picking 
blade 84 has been made thick from around the center in 
the height direction to the bottom side at the general 
center portion in the longitudinal direction at the inner is 
plane. The pressing portions 844 act to press the swing 
detector 86 in the swinging direction, by the swinging of 
the picking blade 84. 

[0074] The shaft portions 843 are swingably sup- 
ported at recessed bearings 85a provided to the attach- 20 
ment member 85 linked to the main body 80A via later- 
described screw 95. In this supported state, the apex 
841 side protrudes outwards through both openings 80a 
and 80b. 

[0075] Also, one of the two constant thickness pro- 25 
trusions 842 is supported by an elastic nipping member 
1 00 having a general shape of a box with one side open, 
attached to the attachment member 85 with a screw 99. 
Incidentally, the two protrusions 842 are provided at 
symmetrical positions in the longitudinal direction of the 30 
picking blade 84. This elastic nipping member 100 is 
formed of a spring material, has two nipping portions 
100a, and the protrusion 842 is inserted between the 
two nipping portions 100a. Accordingly, when the pick- 
ing blade 84 is picked and rotates, the constant thick- 35 
ness protrusion 842 tilts and the gap between the two 
nipping portions 100a begins to open, so conversely the 
two nipping portions 100a attempt to close. Thus, the 
picking blade 84 returns to the original reference posi- 
tion. 40 
[0076] With the picking unit 83 this configured, pick- 
ing the picking blade 84 toward a swinging direction 
causes the swing detector 86 at one side to press 
against the pressing portion 844 at the relevant side. 
The swing detector 86 outputs a sound generation 45 
instruction signal as a sound generation instruction tim- 
ing at the point at that a certain amount of time has 
elapsed from the point of pressing thereof. The reason 
that such a time lapse is provided is to come closer to 
the state of an actual guitar string being played and gen- so 
erating sound, thereby creating a more realistic feel. 
Also, when the above picking is performed, the constant 
thickness protrusion 842 tilts and the gap between the 
two nipping portions 100a begins to open, so con- 
versely the two nipping portions 1 00a attempt to close, ss 
so the picking blade 84 returns to the original reference 
position. The above is the same even in the case that 
the picking blade 84 is picked in the other swinging 



direction, though the relevant swing detector 86 is differ- 
ent. 

[0077] Also, with this configuration, the protrusion 
842 is inserted between the two nipping portions 100a 
to support the picking blade 84, so there is the advan- 
tage that not only the picking unit 83 but also the mimic 
guitar 80 can be assembled extremely easily. 
[0078] Next the assembly process for the mimic 
guitar 80 will be described with reference to Figs. 24 
through 30. Fig. 24 is a disassembled perspective view 
illustrating the overall assembly state, and Figs. 25 
through 30 are perspective view illustrating the assem- 
bly states of each portion. 

[0079] First, as shewn in Fig. 25, the neck unit 80B 
is attached to the main body 80A via screws 1 01 . At this 
time, the attaching is performed such that both open- 
ings 80a and 80b match. Subsequent processes can be 
performed for each part, and the order does not matter. 
[0080] Regarding the neck buttons R, G, B portion, 
this is conducted as follows. As shown in Fig. 24, the 
neck buttons R, G, B are attached to the neck unit 80B, 
push switches 90 are mounted on the neck buttons R, 
G, B, a substrate 91 is mounted thereupon, and the 
whole is fixed by screws 97. 

[0081 ] Also, regarding the portion of the picking unit 
83, this is performed as follows. First. The picking blade 
84 is placed in the opening 80a of the main body 80A 
with the apex 841 downwards, and the attachment 
member 85 is mounted thereupon with the bearing por- 
tions 85a facing down. At this time, the attachment 
member 85 has an elastic nipping member 100 having 
a general shape of a box with one side open attached by 
a screw 99, as shown in Fig 26. A the time of mounting 
the attachment member 85 onto the picking blade 84, 
the protrusion 842 is inserted between the two nipping 
portions 100a of the elastic nipping member 100, and at 
that time, two protrusions 842 are symmetrically pro- 
vided in the longitudinal direction of the picking blade 84 
as described above, so there is no problem in the event 
that the picking blade 84 itself is attached backwards in 
the longitudinal direction. Next, push switches 86 are 
attached to the two attachment holes 85b provided to 
the attachment member 85, a substrate 87 is mounted 
thereupon, and the whole is fixed with screws 95. Fig. 
27 is a cross-sectional view illustrating the elastic nip- 
ping member 100 following fixing thereof. 
[0082] Also, regarding the portion of the push 
switches 81 and 82, the following is carried out. First, as 
shown in Fig. 24 and Fig. 28, the push switches 81 and 
82 are attached to the openings 80c and 80d of the 
main body 80A, and switch elements 89a and 89b are 
attached thereupon, following which a substrate 88 is 
provided over the same and is fixed by screws 96. 
[0083] Also, regarding the portions other than the 
above, i.e.. the protective member 94 for protecting the 
cord 87a electrically connected with the substrate 87, 
and the strap attaching members 92 and 93 for attach- 
ing a strap to the mimic guitar 80 for hanging on the 
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shoulder, these are attached to recesses formed around 
the main body 80A.* 

[0084] Accordingly, with a mimic guitar 80 manufac- 
tured by such a process, the picking blade 84 is easily 
supported by the elastic nipping member 1 00 simply by s 
inserting the protrusion 842 between two nipping por- 
tions 100a, and also subsequent member attachment is 
performed unrelated to the supported state of the pick- 
ing blade 84, so assembly can be carried out easier 
than mimic guitars of a configuration which uses a coil 
spring for the picking unit 83. 

[0085] Incidentally, with the mimic guitar 80, an 
elastic nipping member 100 having a general shape of a 
box with one side open is used, but the present inven- 
tion is not restricted to this. For example, an elastic nip- 
ping member consisting only of two nipping portions 
100a, or an elastic nipping member 100 having only the 
portion which nips the protrusion 842 formed so as to 
have the general shape of a box and the linking portion 
situated therebetween formed as a plate of elastic 
material, may be used. 

[0086] As described above, the rhythm game appa- 
ratus is comprised of: a rhythm sound data storage 
device for storing a plurality of selective sound types (or 
groups) and a series of rhythm sounds in each selective 
type or group; a display device for displaying image data 
concerning occurrences of sounds in each sound group 
with time passing; a sound generation device; an instru- 
mental unit integrally comprising an sound group selec- 
tor for selecting a sound group and an instructor for 
instructing generation of a sound in the sound group 
selected by the sound group selector to the sound gen- 
eration device; a judging means for judging whether or 
not the sound selected by the sound group selector is 
instructed by the instructor within a predetermined time; 
a sound generation controller for generating at least 
background sound to the sound generation device; and 
an evaluator for comparing the operating timing of the 
instructor and the timing of the displayed instruction, 
and for evaluating the instruction operation based on a 
total of differences therebetween. 
[0087] Also, the rhythm game production method 
comprises the steps of: displaying a plurality of selective 
sound types or groups and a sequence of rhythm 
sounds in each type (or group) with time passing, allow- 
ing the game player to instruct generation of a sound in 
a selected sound group; and judging whether or not the 
sound is instructed within a predetermined time; com- 
paring the instruction timing and the predetermined 
sound generation timing; and evaluating the instruction 
operation based on a total of differences therebetween. 
[0088] The computer-readable storage medium 
stores the program comprising the steps of displaying a 
plurality of selective sound types (or groups) and a 
sequence of rhythm sounds in each type or group with 
time passing, allowing the game player to instruct gen- 
eration of a sound in a selected sound group; and judg- 
ing whether or not the sound is instructed within a 



predetermined time; comparing the instruction timing 
and the predetermined sound generation timing; and 
evaluating the instruction operation based on a total of 
differences therebetween. 

[0089] The sound generation control is performed 
by the sound group selection and the generation 
instruction, so a rhythm-matching game can be enjoyed 
relatively easily in a manner closer to real playing of an 
instrument. Also, operation evaluation can be per- 
formed for players who have operated only by listening 
to background music. 

[0090] In other words, the inventive rhythm game 
apparatus performs a rhythm-matching game with 
sound generation input by operation of the player. 
Accordingly, there are provided rhythm selecting means 
of selecting and instructing a correct sound with respect 
to a played music piece; and a rhythm input instrumen- 
tal unit having an instruction means for instructing gen- 
eration of the rhythm sound; a first storage device (PCM 
data storing unit 12) for storing sound generation data 
for each sound in the played music piece; second stor- 
age device (main RAM 13) for storing the sound gener- 
ation data for each sound in the played music piece and 
the true generation timing data thereof, and also storing 
score points data according to the degree of matching 
of these, and also storing programs stipulating the 
sound generation control procedures and rhythm input 
operating evaluating procedures; sound generation 
controller for following the sound generation control pro- 
cedures to read out the aforementioned sound genera- 
tion data according to the input of the generation signals 
from the aforementioned rhythm input instrumental unit 
so as to perform control of one sound generation of the 
played music piece; and an instruction operation evalu- 
ator for following the rhythm input operating evaluating 
procedures to compare the instruction timing of the 
aforementioned instruction means and the true genera- 
tion timing data, and evaluating the instruction operation 
for score points data corresponding to the degree of 
matching thereof, so as to add score points. The second 
storage means stores notes display control procedures; 
and also comprising a monitor capable of displaying 
images; graphic storage means for storing notes screen 
data of the instruction operation for visually guiding the 
instruction operation with the rhythm input instrumental 
unit; and a display device for updating the notes screen 
data following the notes display control procedures in a 
manner corresponding to the time-system group of the 
played music piece, and performing display control on 
the monitor so as to display whether or not there has 
been a miss in operation with the rhythm input instru- 
mental unit. 

[0091 ] The inventive rhythm game method performs 
rhythm-matching with sound generation input by opera- 
tion of the player, and comprises the steps of: outputting 
a notes display screen to the display means for visually 
guiding the instruction operation with the instrumental 
unit; obtaining the degree of matching between the 
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instruction timing of a sound in the selected sound 
group and the true instruction timing; outputting closer 
sound data according to this degree of matching to 
sound generation device; and evaluating instruction 
operation for score points data corresponding to this 
degree of matching and adding the score points. 
[0092] Moreover, the computer-readable storage 
medium stores a program capable of executing the 
steps of: performing rhythm-matching with sound gen- 
eration input by operation of the player: outputting a 
notes display screen for visually guiding the instruction 
operation with the instrumental unit; obtaining the 
degree of matching between the instruction timing and 
the true generation time; outputting closer sound data 
according to this degree of matching to sound genera- 
tion device; and evaluating instruction operation for 
score points data corresponding to this degree of 
matching and adding the score points. 
[0093] According to these configurations, the sound 
generation control and instruction operation evaluation 
may be performed by the sound group selection and the 
generation instruction. Accordingly, a rhythm-matching 
game can be enjoyed relatively easily in a manner 
closer to real playing of an instrument Also, when con- 
ducting this rhythm game, the changing sound group 
selection and the generation instruction timing may be 
displayed on the monitor. Thus, the rhythm-matching 
game can be performed in an easier manner, such that 
the rhythm-matching game can be played for even rela- 
tively difficult pieces. 

[0094] Also, another aspect of the present inven- 
tion, there are provided a rhythm sound data storage 
device for correlating identification symbols to each 
sound data of a played musical piece including at least 
rhythm sound, and for storing the same; a display 
means; a display device for sequentially displaying on 
the display means a plurality of identification marks indi- 
cating the identification symbols corresponding with 
each piece of sound data comprising the played musical 
piece, and also for instructing the operating timing cor- 
responding to each identification mark being displayed; 
a sound generation device; an instrumental unit inte- 
grally comprising an sound group selector having a 
selection portion equivalent to the type of the identifica- 
tion mark for selectively instructing an identification 
mark corresponding to the sound data of the rhythm 
sound data storage device and an instructor for instruct- 
ing the generation of the sound corresponding to the 
identification mark selected by the sound group selector 
to the sound generation device; a judging means for 
judging whether or not the sound data selected by the 
sound group selector is instructed as operating timing 
within the certain interval by the instructor; a sound gen- 
eration controller for generating at least background 
sound to the sound generation device; and an evaluator 
for comparing the operating timing of the instructor as to 
the sound data instructed as the operating timing and 
the timing of the operating timing display instruction, 



and for evaluating the instruction operation from the dif- 
ference amount thereof. 

[0095] Also, the sound generation controller may be 
made to output sound data instructed as the operating 

5 timing to the sound generation device so as to generate 
sound, at the point that the sound generation instructing 
member is operated in a state that the judging means 
has affirmed, at the operating timing of the user. Fur- 
ther, as described above, the sound generation control- 

10 ler may be made to output sound data instructed as the 
operating timing to the sound generation device so as to 
generate sound, at each certain point in a state that the 
judging means has affirmed, such that sound is gener- 
ated at each certain point by the sound generation con- 

is troller. In this case as well, the same advantages of the 
above aspect bf the present invention are exhibited. 
[0096] The evaluator may evaluate based on the 
total difference amount obtained by accumulating the 
difference amount to each piece of sound data. Further, 

20 as described above, the evaluator may set a tolerance 
range before and after the operating timing for each 
sound data, and calculate score by accumulating addi- 
tion parameters set according to the smallness of the 
amount of being off within the inner side of the boundary 

25 of the tolerance range as a reference thereof, and sub- 
traction parameters set according to the greatness of 
the amount of being off at the outer side thereof. 
Though this arrangement is such wherein the higher the 
score is, the higher the skill is deemed to be, but an 

30 arrangement may be made wherein the higher the 
score is, the lower the skill is deemed to be. 
[0097] According to these configurations, the sound 
generation control and instruction operation evaluation 
is performed by the sound group selection and the gen- 

35 eration instruction, so not only can evaluation be made 
by listening to the sounds produced by the player him- 
self/herself or others, accurate evaluation can be made 
with evaluation standards, so particularly two can play 
and compete based on the evaluation standards, ena- 

40 Wing the rhythm-matching game to be even more fair 
and enjoyable. 

[0098} Further, as described above, the sound data 
may contain at least either of scales or chords. Accord- 
ing to this configuration, the sounds generated by sound 

45 generation instruction have a rich variety, and the 
rhythm-matching game can be further enjoyed. 
[0099] The display device may comprise: a graphic 
storage device for storing notes screen data for visually 
guiding the instruction operation by the instrumental 

so unit; and a graphic controller sequentially updating the 
notes screen data according to the group of the time- 
system of the played music piece, and also for display- 
ing whether or not there has been a miss in the input 
operation by the instrumental unit. According to the 

55 above configuration, sound generation instruction is 
performed with the notes screen as a guide, so the 
rhythm-matching game can be easily played for even 
relatively difficult played music pieces. Also, misses in 
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the input operation qre displayed on the notes screen in 
real-time, so the player can identify and immediately 
correct his/her mistake in real-time, thereby allowing the 
rhythm-matching game to be enjoyed at an even higher 
level. 

[0100] Regarding the instrumental unit, one of the 
input means for the right hand of the player and the 
input means for the left hand of the player may comprise 
the sound group selector, and the other comprise the 
instructor. Also, as described above, regarding the 
instrumental device, one of the input means for the right 
hand of the player and the input means for the left hand 
may comprise the sound group selector, and the other 
comprise the sound generation instructing member. 
[0101] According to this configuration, the rhythm- 
matching game can be played using the right hand and 
left hand in a manner closer to reality. 
[0102] The instrumental unit may have a form mim- 
icking that of a guitar, the sound group selector config- 
ured of a plurality of neck buttons corresponding to the 
series of rhythm sound types, and the instructor config- 
ured of one picking unit. Also, the instrumental device 
described above may have a form mimicking that of a 
guitar, wherein the sound group selector is configured of 
a plurality of neck buttons corresponding to the series of 
rhythm sound types, and the instructor is configured of 
one picking unit. 

[0103] According to this configuration, the rhythm 
game apparatus according to the present invention can 
be easily applied to playing with a mimic guitar. 
[0104] The picking unit may comprise: a picking 
blade provided swingably; a restoring mechanism for 
restoring a blade portion of the picking blade to a refer- 
ence position with respect to the instrumental unit; and 
a swing detector for detecting the swing of the picking 
blade to determine a sound generation timing. 
[0105] According to this configuration, the picking 
unit can be obtained wherein a simpler configuration 
can be used to obtain a realistic feel close to that of pick- 
ing a mimic guitar, and more precise instruction timing 
can be made. 

[0106] It may be appreciated to provide a pair of 
elastic members below the picking blade. One member 
of the pair is provided on one swing side while the other 
member is provided on the other swing side. It may be, 
also, appreciated that the picking blade is formed with a 
protrusion extending inside, and the restoring mecha- 
nism includes an elastic support holding the protrusion 
in a swingable manner. Also, as described above, the 
picking blade may be provided swingably with respect to 
the instrumental unit and also have a protrusion protrud- 
ing from the inner plane thereof toward the inner side of 
the instrumental unit, and the restoring mechanism 
have an elastic nipping member for nipping the protru- 
sion from both sides of the swinging direction of the 
picking blade and also support the picking blade in a 
swingable manner; and the picking blade is supported 
at the reference position by elastic nipping pieces by 



inserting the protrusion in the portion for nipping the 
protrusion of the elastic nipping member. 
[01 07] In the case a configuration described above, 
by inserting the protrusion of the picking blade into the 

5 portion of the elastic nipping member for nipping the 
protrusion, the picking blade is supported thereby, so 
the picking blade can be easily attached, and ease of 
attaching the picking blade can be improved over the 
case of another above-described arrangement. Particu- 

10 larly in the case of the invention described in the previ- 
ous paragraph, by inserting the protrusion of the picking 
blade into the portion of the elastic nipping member for 
nipping the protrusion, the picking blade Is supported in 
the reference position, which is even more preferable. 

15 [01 08] Further, the sound generation controller may 
be provided with: a difference amount detector for 
detecting a difference between the sound generation 
length of the sound data according to the sound gener- 
ation instruction from the instrumental unit and the time 

20 range of generating sound of the sound data; and sound 
generation control means for outputting to the sound 
generation device the sound data of the side containing 
more sound generation length of sound data according 
to the sound generation instruction, in the time range for 

25 generating sound of continuing sound data. According 
to the above configuration, outputting sound generation 
based on the degree of matching of the sound group 
selection and the instruction timing makes for a less 
unnatural sound generation corresponding with the 

30 playing. 

[01 09] Further, the rhythm input operating evaluator 
may perform adding of scored points in the event that 
the position of the instrumental unit is changed at a cer- 
tain period in the played music piece. According to this 

35 configuration, changing the way of holding the rhythm 
input instrumental unit with the sensation of a live per- 
formance, such as raising along with the music in the 
case of a mimic guitar for example, allows the rhythm- 
matching game to be enjoyed more. 

40 [01 1 0] The sound generation control and instruction 
operation evaluation are performed by the sound group 
selection and the instruction timing. Accordingly, a 
rhythm-matching game can be enjoyed relatively easily 
in a manner closer to a realistic state of playing an 

45 instrument. 

[01 1 1 ] The sound generation control and instruction 
operation evaluation is performed by the sound group 
selection and the instruction timing, so not only can 
evaluation be made by listening to the sounds produced 

so by the player himself/herself or others, accurate evalua- 
tion can be made with evaluation standards, so particu- 
larly two can play and compete based on the evaluation 
standards, enabling the rhythm-matching game to be 
even more fair and enjoyable. 

55 [0112] The sounds generated by sound generation 
instruction have a rich variety, and the rhythm-matching 
game can be further enjoyed. 

[0113] The sound generation instruction is per- 
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formed with the notes screen as a guide, so the rhythm- 
matching game can be easily played for even relatively 
difficult pieces. Also, misses in the input operation are 
displayed on the notes screen in real-time, so the player 
can identify and immediately correct his/her mistake in 5 
real-time, thereby allowing the rhythm-matching game 
to be enjoyed at an even higher level. 
[0114] The sound generation based on the degree 
of matching of the sound group selection and the 
instruction timing makes for a less unnatural sound gen- 10 
eration corresponding with the playing. 
[0115] Changing the way of holding the rhythm 
input instrumental unit with the sensation of a live per- 
formance, such as raising along with the music in the 
case of a mimic guitar for example, allows the rhythm- is 
matching game to be enjoyed more. 
[0116] The rhythm-matching game can be played 
using the right hand and left hand in a manner closer to 
reality. 

[0117] The rhythm game apparatus according to 20 
the present invention can be easily applied to playing 
using a mimic guitar. 

[0118] The picking unit can be obtained wherein a 
simpler configuration can be used to obtain a realistic 
feel close to that of picking a mimic guitar, and more pre- 25 
cise instruction timing can be made. 
[01 1 9] In the case of another configuration 
described above, inserting the protrusion of the picking 
blade into the portion of the elastic nipping member for 
nipping the protrusion allows the picking blade to be 30 
supported thereby, so the picking blade can be easily 
attached, and ease of attaching the picking blade can 
be improved over the case of using the elastic means in 
another configuration also described above. Particu- 
larly, in the case of the invention described in the above- 35 
note paragraph, by inserting the protrusion of the pick- 
ing blade into the portion of the elastic nipping member 
for nipping the protrusion, the picking blade is supported 
in the reference position, which is even more preferable. 
[0120] The sound generation based on the degree 40 
of matching of the sound group selection and the 
instruction timing makes for a less unnatural sound gen- 
eration corresponding with the playing. 
[0121] Changing the way of holding the rhythm 
input instrumental unit with the sensation of a live per- 45 
formance, such as raising along with the music in the 
case of a mimic guitar for example, allows the rhythm- 
matching game to be enjoyed more. 
[0122] As this invention may be embodied in sev- 
eral forms without departing from the spirit of essential so 
characteristics thereof, the present embodiment is 
therefore illustrative an not restrictive, since the scope 
of the invention is defined by the appended claims 
rather than by the description preceding them, and all 
changes that fall within metes and bounds of the claims, ss 
or equivalence of such metes and bounds are therefore 
intended to embraced by the claims. 



Claims 

1 . A rhythm game apparatus, comprising: 

a sound data storage device which stores at 
least data concerning sounds, the sounds 
being sorted into a plurality of selective sound 
groups; 

a display device which displays occurrences of 
sounds in each of the plurality of selective 
sound groups in accordance with time passing; 
an instrumental unit to which a game player 
operates, the instrumental unit being provided 
with: 

a sound group selector which is to be operated 
by the game player to select a sound group, 
and 

an instructor which is to be operated by the 
game player to instruct generation of a sound; 
an evaluator which evaluates the operation of 
the game player based on a time gap between 
the instruction timing of the instructor and the 
predetermined timing of a sound in a selected 
sound group. 

2. A rhythm game apparatus according to claim 1 , fur- 
ther comprising a sound generator which generates 
an instructed sound. 

3. A rhythm game apparatus according to claim 2, fur- 
ther comprising a judger which judges whether the 
instruction timing of the instructor is within an allow- 
able time range of the sound, wherein the sound 
generator generates the sound when the instruction 
timing is within the allowable time range. 

4. A rhythm game apparatus according to claim 2, fur- 
ther comprising a judger which judges whether the 
instruction timing of the instructor is within an allow- 
able time range of the sound, wherein the sound 
generator generates the sound at a predetermined 
interval when the instruction timing is within the 
allowable time range. 

5. A rhythm game apparatus according to anyone of 
the preceding claims, wherein the evaluator evalu- 
ates the operation of the game player based on a 
total of differences with respect to a predetermined 
number of sounds. 

6. A rhythm game apparatus according to anyone of 
the preceding claims, wherein the evaluator has for 
evaluation an addition parameter for a difference 
within a predetermined tolerance range and a sub- 
traction parameter for a difference out of the prede- 
termined tolerance range. 

7. A rhythm game apparatus according to anyone of 
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the preceding claims, further comprising a sound 
generator operable to generate a background 
sound. 

8. A rhythm game apparatus according to anyone of 
the preceding claims, wherein the sound data 
includes scale data and/or chord data. 

9. A rhythm game apparatus according to anyone of 
the preceding claims, wherein the display device 
comprises: 

a graphic storage device which stores note 
screen data for visually guiding the instruction 
operation; and 

a graphic generator which generates an 
updated note screen in accordance with time 
passing, and an updated failure screen indica- 
tive of whether or not the instruction timing is 
within the allowable range. 

10. A rhythm game apparatus according to anyone of 
the preceding claims, wherein one of the sound 
group selector and the instructor is arranged for the 
right hand of the game player, and the other is 
arranged for the left hand. 

11. A rhythm game apparatus according to anyone of 
the preceding claims, wherein the instrumental unit 
is in the form of a guitar, the sound group selector is 
configured into a plurality of neck buttons corre- 
sponding to the plurality of sound groups, respec- 
tively, and the instructor is configured into a picking 
unit. 

12. A rhythm game apparatus according to claim 11, 
wherein the picking unit comprises >• 

a picking blade provided swingably; 

a restoring mechanism for restoring a blade 

portion of the picking blade into a reference 

position with respect to the instrumental unit; 

and 

a swing detector for detecting a swing of the 
picking blade to determine a sound generation 
timing. 

13. A rhythm game apparatus according to claim 12, 
wherein the restoring mechanism includes a pair of 
elastic members provided below the picking blade, 
one member of the pair being arranged on one 
swing side and the other member being arranged 
on the other swing side. 

14. A rhythm game apparatus according to claim 12, 
wherein the picking blade is formed with a protru- 
sion extending inside, and the restoring mechanism 
includes an elastic member for holding the protru- 



sion of the picking blade in a swingable manner. 

15. A rhythm game apparatus according to anyone of 
the preceding claims, further comprising a posture 

5 detector for detecting whether the instrumental unit 
is placed in a particular posture in a predetermined 
time, wherein the evaluator gives an additional 
score to the evaluation when the instrumental unit 
is placed in the particular posture in the predeter- 

10 mined time. 

16. An instrumental device for use with a rhythm game 
apparatus including a sound data storage device 
which stores at least data concerning sounds, the 

is sounds being sorted into a plurality of selective 
sound groups, a display device which displays 
occurrences of sounds in each of the plurality of 
selective sound groups in accordance with time 
passing, a sound generator which generates a 

20 sound, the instrumental device comprising 

a sound group selector which is to be operated 
by one of the both hands of a game player to 
select a sound group; and 
25 an instructor which is to be operated by the 

other hand of the game player to instruct the 
sound generator to generate a sound. 

17. An instrumental device according to claim 16, 
30 wherein the instrumental device is in the form of a 

guitar, the sound group selector is configured into a 
plurality of neck buttons corresponding to the plural- 
ity of sound groups, respectively, and the instructor 
is configured into a picking unit. 

35 

18. An instrumental device according to claim 17, 
wherein the picking unit comprises: 

a picking blade provided swingably; 
40 a restoring mechanism for restoring a blade 

portion of the picking blade into a reference 
position with respect to the instrumental unit; 
and 

a swing detector for detecting a swing of the 
45 picking blade to determine a sound generation 

timing. 

19. An instrumental device according to claim 18, 
wherein the restoring mechanism includes a pair of 

so elastic members provided below the picking blade, 
one member of the pair being arranged on one 
swing side and the other member being arranged 
on the other swing side. 

55 20. An instrumental device according to claim 1 8 or 1 9, 
wherein the picking blade is formed with a protru- 
sion extending inside, and the restoring mechanism 
includes an elastic member for holding the protru- 
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sion ol the pikking blade in a swingable manner. 

21 . A method for producing a rhythm game, comprising 
the steps of: 

5 

giving a game player a visual display of occur- 
rences of sounds in each of a plurality of selec- 
tive sound groups in accordance with time 
passing; 

detecting a time gap between a predetermined w 
generation timing of a sound in a selected 
sound group and an instruction timing of the 
game player to judge whether the sound is 
allowed to be generated; 

generating the particular sound based on the is 
judgment; and 

evaluating the operation of the game player 
based on the detected time gap. 

22. A method according to claim 21 , wherein the game so 
player is given a back-ground music in connection 
with the displayed sound occurrences. 

23. A computer-readable storage medium storing a 
program of executing the steps: 25 

giving a game player a visual display of occur- 
rences of sounds in each of a plurality of selec- 
tive sound groups in accordance with time 
passing; 30 
detecting a time gap between a predetermined 
generation timing of a sound in a selected 
sound group and an instruction timing of the 
game player to judge whether the sound is 
allowed to be generated; 35 
generating the particular sound based on the 
judgment; and 

evaluating the operation of the game player 
based on the detected time gap. 

40 

24. A computer-readable storage medium according to 
claim 23, wherein the game player is given a back- 
ground music in connection with the displayed 
sound occurrences. 
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